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Abstract 

We develop a general technique to calculate the probability of tran- 
sitions over the barriers in spin-glasses in the framework of the dynam- 
ical theory. We use Lagrangian formulation of the instanton dynamics 
in which the transitions are represented by instantons. We derive the 
full set of the equations that determine the instantons but instead 
of solving them directly we prove that an instanton process can be 
mapped into a usual process going back in time which simplifies the 
problem significantly. We apply this general considerations to a simple 
example of the spherical Sherrington-Kirkpatrick model and we find 
the probability of the transition between the metastable states which 
is in agreement with physical expectations. 

1 Introduction 

It is well known that all spin-glass systems have complicated free energy 
structures with many metastable states separated by large barriers The 
calculation of heights of these barriers is a difficult task even for the long- 
range spin-glass models because most of the methods developed in the spin 
glass theory do not give such information. For example, the application of the 
standard replica method allows to find the equilibrium free energy which 
does not contain any information about the heights of the barriers. The stan- 
dard dynamical approach ^ gives the properties of different metastable 
states and their history dependence and might contain, in principle, the infor- 
mation about the transition rates between them but in the limit of long-range 



interaction the probability of transitions becomes exponentially low in the 
number of spins, A^, and, thus, such processes are neglected by the mean 
field derivation of the equations for the correlation and response functions on 
which this aproach is usually based. The modification of the replica method 
that allows to estimate the energy barriers between metastable states was 
suggested in Ref. 0. The main idea of this modification is to study the free 
energy of the state constrained to have a certain overlap with the given state. 
The main drawback of it is that it is not clear whether the state correspond- 
ing to the energy maximum found by this method is dynamically accessible 
and that it is indeed a bottleneck of a transition process. The problem is 
exacerbated by the fact that the replica method weights all states with the 
Boltzmann weight so it might miss the rare saddle points of low energy in 
favour of more abundant high energy ones. In this paper we develop an al- 
ternative technique which is based on the modified dynamical approach ^ 
for the calculation of the barriers between the metastable states. 

Before we discuss how to modify the dynamical theory so it does not 
neglect rare processes such as transitions over the barriers we briefly review 
the standard dynamical approach to the spin-glasses. In this approach one 
starts from the Lagrangian formulation of the Langevin dynamics, averages 
over the disorder and, making the saddle point approximation, arrives at a 
closed system of equations for the sigle site spin-spin correlation function 
D{ti, ^2) and response function ^2)- The corrections to the saddle point 
approximation are small in 1/N because interaction has a range A^. For ex- 
ample, in the case of the spherical p-spin interacting model one gets a set 
of integro-differential equations which were solved numerically (and partially 
analytically); the solution is made possible by the fact that these equations 
are forward propagating in time which is in turn due to the causality of the 
Langevin equations and initial conditions imposed in the past By con- 

struction these mean field equations describe the most probable evolution 
of the system in time and ignore all rare processes such as transitions over 
the barriers. Empirically we visualize the processes that give the main con- 
tribution to the conventional dynamical theory as motion down the energy 
landscape or small fluctuations near the bottom of the valley. 

Consider now a typical dynamical process that corresponds to the tran- 
sition between two close metastable states in a free energy landscape shown 
in Fig. 1. The system initially is in the state 1 and we want to find the 
probability of the transition to the state 2. The path from point 1 to point 2 
consists of the uphill motion from state 1 to the unstable stationary point 3 
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and the motion from unstable point 3 to stable state 2. Only the first part of 
the motion corresponds to the rare process, and, therefore, the probability of 
the transition between the states 1 and 2 is determined by the uphill motion 
from 1 to 3. In the Lagrangian formulation of the Langevin dynamics the 
uphill motion can be described as an instanton which action gives the proba- 
bility of the process. Note that to find this solution one needs to "force" the 
system to go upward, i.e. one needs to apply a boundary condition in future 
(at point 3 in our example) that destroys causality of the theory. This com- 
plicates enormously the dynamical equations describing the instanton motion 
compared to the dynamical equations describing typical processes (such as 
motion from 3 to 2). 

The main result of this paper is that an instanton motion can be mapped 
into a usual motion going back in time. In our example it means that the 
uphill motion from point 1 to point 3 can be mapped into the usual downhill 
motion from point 3 to point 1. This allows one to solve the usual forward 
propagating equations instead of solving the complicated equations describ- 
ing the instanton motion. In general, this method does not allow one to 
find the barrier beween one given state and another but it allows one to find 
some instanton processes which, hopefully, correspond to typical barriers in a 
system. In the simple example of a spherical Sherrington- Kir kpatrick model 
which we consider here it gives the barrier that separates doubly degener- 
ate ground states that differ by the sign of the magnetization; this barrier 
is physically important because it controls the decay of the ground state 
magnetization in this system. In this model there are only two locally stable 
states and N locally unstable ones, naturally one expects that these unstable 
states are saddle points and the trajectory which connects two ground states 
must go through one of them but these general qualitative arguments do 
not indicate which of these saddle points should be used. Qualitatively the 
problem is that even in this simple model the lowest saddle point might not 
connect two different minima but connect one minima to itself (false pass). 
Our approach proves that it is sufficient to climb up to the lowest of them in 
order to get from one ground state to another. 

Further, we confirm that in case when the free energy landscape of the 
problem is known explicitly, the probability of the transition obtained as an 
action of the instanton solution is e~^^/^ where AF is the difference between 
the free energy at the end of the instanton trajectory (point 3) and the free 
energy of the stationary state (point 1). The free energy at the unstable fixed 
point 3 should be understood as F — E — TS, where E is the energy and 
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Figure 1: Energy landscape illustrating a transition between states 1 and 

2 via saddle point 3. Uphill motion from 1 to 3 is a rare process which is 
missed by conventional mean field dynamical equations for the spin glasses, 
the action corresponding to this process is large in A^. Downhill motion from 

3 to 2 does not cost any action and is described by the conventional dynamic 
equations, its action is zero. 



S is the entropy defined as a logarithm of the configuration space restricted 
to the direction perpendicular to the trajectory. Of course, there is no much 
need to calculate the transition probability if the energy of the saddle point 
in known exactly and it is established that the saddle point is dynamically 
accessible; the advantage of the method is that it can be also used in the 
cases where energy lanscape can not be found explicitly, e.g. in all problems 
in which the disorder average was performed first. 

The paper is organized as follows: In Section ^ we prove that an instanton 
equation of motion can be mapped into a usual equation of motion reversed 
in time. In Section |^ we consider an instanton transition in the spherical SK 
model. Section ^ summarizes our results. 



2 Instanton equations 

We start from the Langevin equation describing the overdamped relaxation 
of the system with energy Ti 

To dtai = — - — + ^i. 

OCTi 

Here C,i is the Langevin noise with the correlator 

miMt2)) = 2T^%,j5{h-t,) (1) 

Below we shall choose the time units so that Fq = 1. Using the standard 
approach ^ we get a path integral formulation of the problem with the 
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Lagrangian 



(2) 



The Green functions are defined by 



DaDa e-''- 
and the dynamical action A is defined by 



Dij{ti,t2) Glj{ti,t2) 
Gijiti,t2) Dij{ti,t2) _ 

CTiitl] 



[taj{t2),aj{t2)], 



(3) 



DcxDae 



(4) 



Usually one fixes only initial boundary conditions. In this case the Green 
function G is casual, the anomalous Green function D is zero, and the action 
vanishes. But if one considers rare processes as transitions over the barriers, 
then one should also fix the final boundary conditions. In that case the Green 
function G does not need to be causal, and the action and the Green function 
D do not necessarily vanish. 

Now we construct a mapping between an uphill motion (with a negative 
action monotonically decreasing in time) and the downhill motion (with zero 
action) going back in time. Consider arbitrary instanton process {o'{t),d{t)) 
and impose both initial and final boundary conditions. Applying the trans- 
formation 



[icr, a] [ia + dta, a] 
to the Lagrangian (0) we get 



(5) 



+(3{H{tf)-H{U)) (6) 

Note that this Lagrangian differs from the original Lagrangian (^ only by 
the sign of time derivative and constant boundary term. Therefore inverting 
time in the Lagrangian (P) one can make the Lagrangians (@,|]) equivalent. 
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Therefore, the Lagrangian (j^) describes normal downhill motion formally 
inverted in time. 

The Green function defined as averaged with respect to Lagrangian (3) 



(7) 



and the Green function defined as averaged with respect to the Lagrangian 



Gn{tl, t2] 



(8) 



are related by 



1 dti 
1 



1 

"dn 1 



(9) 



Because the Green function Qn corresponds to the normal downhill process 
inverted in time, it should have the form 



Gt 

Gn Dn 



Therefore the transformation (P) in components is 



(10) 



D(tiM) = DnitiM) (11) 

G{ti, h) = Gnih, h) + d2Dn{ti, h) (12) 

bit^M) = diGn{hM) + d2Gi{hM) + did2D^{hM)- (13) 

Note that the response function G„ should be purely advanced due to formal 
inversion of time with respect to the downhill motion. 

Thus, in order to construct the Green functions for the instanton processes 
one should find the Green functions for the corresponding normal process, 
invert time, and apply the transformation (^. 

Now we show that the action can be expressed through the energies and 
configuration spaces of the initial and final states: Suppose that initially 
the system is at the stable state s, and we want to find the probability to 
escape this state going trough the unstable fixed point u which is the final 
state of the instanton motion. Note that in all the above considerations we 
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Figure 2: 



assumed completely fixed boundary conditions for (Xj. But physically, initial 
and final states correspond to some regions in configuration states which we 
denote as and F^ respectively. To emphasize the difference between the 
process with completely fixed boundary conditions and the processes with 
physical boundary conditions we refer to the former as elementary processes. 
According to Eqs.(0,|^) the probability of an elementary process of motion 
from s to M (wsu) is related to the elementary process of motion from m to s 
(wus) through 

«^.„ = ^nse^(^(*^)-^(*^«. (14) 
The probability to escape the state s is 

Wsu = ^uWsu- (15) 

On the other hand the probability to go from the unstable state u to the 
stable state s is 1, therefore 

W^s = WusTs = 1. (16) 



Combining Eqs.(n. T3|JT^ ) for the probability to escape the stable state u we 
get 

Wsu = exp[-(3{E{tf) - EiU)) + S{tf) - S{U)l (17) 

where = In F is the entropy. Note that at the stable point the entropy S{ti) 
is just the equilibrium entropy corresponding to this state. The entropy of the 
final state S{tf) can not be defined thermodynamically because it corresponds 
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to the configuration space of tlie unstable state. Defining the free energy as 
F = E — TS one can write (|1^) as 

Wsu = e-^^(*/)+^^(*>). (18) 



3 Instanton transition in the spherical SK model. 



The Hamiltonian of the spherical SK model is 

1 



n 



2 ^ - 



(19) 



with the spherical constraint J2i '^i'^i = ^ imposed. The Hamiltonian be- 
comes diagonal in the basis of eigenvectors of the matrix J^j 

1 



n 



2 ^ M ■'m' 



where 



The Lagrangian corresponding to this model is 



Cis, \) = -J2[sl + ts,{dt + + \)s,] +\{N + 2)A, 



(20) 

(21) 
(22) 

(23) 



where A is the time- dependent Lagrange multiplier field which appears in the 
equation of motion due to the constraint and we take /3 = 1 for convenience. 
The functional integral over the variables s^, should be performed with 
the weight that includes 5— function that ensures the constraint. Using the 
integral representation of this 5— function 



we get the following Lagrangian 



(24) 



C{s, s, A, I 



E ~ ^■^^(^t + + A)s^ + ^0 s 



+ -{N + 2)\~i(t)N. 



(25) 



At low temperatures the condensation into the lowest eigenvalue = even- 
tually takes place. Therefore we introduce the condensate Sq and integrate 
over with > 1 getting 



.q2 
•^0 



iSo{d + eo + X)So + i<p Si + ]^{N + 2)X- k^N 



^ Tr In 



where the matrix Green function 
satisfies the equation 



(26) 



(27) 



(28) 



-2 dti + X{ti) + 

-dti + A(ti) + 4>{ti) 

The number of cites is large, therefore we will perform the integrals 
with the weight exp(/ Cdt) where £ is given by (p6|) in the saddle point 
approximation. Taking the variation with respect to (j),X, Sq, Sq and trans- 
forming the variables via — 2i0 — > 0, iS — 
equations 



^T.D, + si = 1, 

/i>l 

T7 X! + '^O'^o ^ 

At>l 

{d + eo + X)So-2So = 0, 

-d + eo + X)So + (l)So = 0, 



NS we get the saddle point 
1, (29) 



(30) 

(31) 
(32) 



where 



Note that Eqs. ( p9| - |3^) contain only the equal time Green functions. Therefore 
it is convenient to write the equations directly for the equal time Green 
functions instead of (^): 

dG,, = 2D^ + (I)D^, (33) 



2(A + e^)D^ + 0(l + 2G^) 
-2(A + e^)D^ + 2(l + 2G 



(34) 
(35) 
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We assume that the system is initially at the equilibrium. This corresponds 
to the stationary solution of Eqs. (p9| - p5| ) 



^E^. + ^o = l, (36) 
/i>i 

D, = -4-, (37) 

As = -eo, (38) 

= = 5o = = 0, (39) 



where A^ is the value of A for this stable stationary solution. Eq.(p8D follows 
from Eq. (^Tj) because we assumed that there is a nonzero condensate density 
Sq. Note that there are two equilibrium states with 5*0 > and Sq < 0. 

Our goal is to find the probability of the instanton transition from one 
state to the other. For definiteness, assume that the initial state is one with 
5*0 > 0. Obviously, 5*0 first decreases to zero during the instanton process and 
then it becomes negative. Only the first uphill part of the motion gives the 
contribution to the action, therefore we will consider only this uphill part of 
the trajectory. The end point of this uphill motion corresponds to an unstable 
fixed point of Eqs. (|29| - |35D . The condensate density 5*0 is zero at this point 



therefore from Eqs.( pP| - P5D we get the following equations corresponding to 
this stationary (but unstable) solution: 

^E^. = 1, (40) 

/i>l 

D, = (41) 
= D^ = So = (l) = 0, (42) 

where A„ is the value of A at this unstable stationary solution. Physically, 
it is natural to expect that that this solution corresponds to the condensate 
in the first eigenstate /i = 1. Indeed, taking A„ = — ei + where Si is the 
condensate at the first eigenstate /i = 1, we get 

^E^. + ^i = 1> (43) 

M>2 



D, = y--. (44) 
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These equations are similar to Eqs. (PB| - PBD for the stable fixed point with the 
difference that the system condenses into the first eigenstate. 

Now we need to find the trajectory connecting the fixed points mentioned 
above. It was shown in the previous section that an uphill trajectory can 
be mapped into a downhill trajectory going back in time. To show this, 
according to Eqs.(|5|JT^), one should take 

G, = IdD,, (45) 
So = dSo, (46) 
where D^, So should satisfy the downhill equations with inverse time 

^E^. + ^o = 1, (47) 

{-d + eo + X)So = 0, (48) 

-dD^ = -2{\ + e^)D^ + 2 (49) 

Indeed, taking 

= (9A, (50) 

D, = \d'D,-^D,dX, (51) 

along with Eqs.(^,|^), one can show that Eqs.(p9|-^) are reduced to Eqs. (^ 
^^1 ). The trajectory connecting the stable and unstable saddle points can be 
found analytically; (see Appendix A) the result is 

A(t) + eo = (A„ + eo)/[2|A, + eo| (to-t)] (52) 
D^.{t) = -^/[2|A„ + eo|(to-t)] 

+ -/[2|A„ + eo|(t-to)], (53) 



where 



f[x] = (54) 

where to is an arbitrary finite time which refiects the translational invariance 
in time. 
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The last step is to calculate the action which determines the probability 
of the instanton process. Note, that to find it, one should take Tr In of 
the operator containing A, (j) which are functions of time. The necessary 
calculation is presented in Appendix B, and the answer, simplified with the 
help of Eqs. (11-11), is 

Using that (p = d\ and = \dD^ we get 



2 

t=tf 

Vln D,. 1 

2 N 



A/iV = i A + l^lnDj . (56) 



/^>i / t=U 

Note that at the fixed points = l/(e^ + A), therefore one can write 



A 



F(A(t;))-F(A(t,)) , (57) 



where F{X) is the equilibrium free energy of this model 

F{\)/N = -A/2 + ^ E He, + A). (58) 

The result (|5^) is in the agreement with the general result ([T8|). As we men- 
tioned in Sec.|| the free energy at the unstable fixed point cannot be defined 
thermodynamically. But in this simple model one can formally eliminate the 
unstable direction (i.e. impose the constraint 5*0 = 0) and then it becomes 
possible to define the free energy thermodynamically. That is why we got the 
difference of the equilibrium free energies in (|58|). Note that the Lagrange 
multiplier A changes during the instanton process on X{tf) — X{ti) = ei — eo. 
The typical distance between neighboring energy levels at the edges of energy 
level distribution is of order of 1/^/N. Therefore one can expand (|58|) in AA 
getting 

A = -^S',{e,-eo), (59) 

where we restored the temperature T. Note that this action is of the order 
of x/N. 
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4 Discussion and conclusions. 



We developed the method that simphfies the calculation of the probablity 
of rare processes such as transitions over the barriers. Our method is based 
on the Lagrangian approach to the dynamics in which rare processes corre- 
spond to the instantons. Generally, in order to obtain the probability of a 
particular transition between two given states one need to apply a boundary 
condition in future and in the past, this destroys the causality of the theory: 
the response function G = (ss) becomes non causal and the anomalous cor- 
relation function D = (ss) appears. This complicates the description of the 
instanton processes. 

The main result of this paper is that an instanton process can be mapped 
into a usual process going back in time. So, knowing the correlation func- 
tions of the corresponding normal process one can construct the instanton 
correlation functions. We showed that this mapping gives the sensible proba- 
bility to escape a free energy well, e~^^^'^, where AF is the depth of the free 
energy well. The free energy at the end of the instanton trajectory cannot be 
defined thermodynamically because at this point the system is at the unsta- 
ble equilibrium, instead it should be defined by F = E — TS, where E is the 
energy and 5* is the statistical entropy at the end of the instanton trajectory, 
i.e. entropy constrained to the states orthogonal to the descending direction. 

We applied this approach to the spherical SK model which usual dynami- 
cal properties were studied in Ref. 0. This model has just two ground states, 
corresponding to the energy level eo, and no other metastable states. Al- 
though the relaxation towards each of these two states is exponential, model 
exhibits aging behavior when the system relaxes from a random spin config- 
uration to the equilibrium. We considered the instanton transition from one 
ground state to the other. In accordance with our general result the equa- 
tions describing the instanton process in this model can be transformed into 
the usual equations with inverted time. This transformation allows one to 
find analytically the instanton trajectory. The probability of this transition 
was found to be e~'^o^('^i-'=o)/2T -^j^gj-g jg ^j^g energy of the first (unstable) 
level. It shows that although the system has N saddle points and a com- 
plicated phase space the path connecting two ground states with opposite 
magnetization might go via the saddle point with the lowest energy. The 
typical distance between the neighboring energy levels at the edge of the en- 
ergy spectrum is of order therefore the action is of order v^. Note 
that the distance between the energy levels ei — eo is different for different 
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samples, therefore the transition probabihty is not a self-averaging quantity. 
Therefore in this problem it would be very difficult to get the correct answer 
for the transition probability in any technique which involves averaging at 
the beginning of calculations. 

We hope that this method can be used to find the barriers between the 
metastable states in more complicated spin glasses like p > 2 spin models or 
SK model. The first attempt of application of the instanton method to SK 
model was done in Ref. [§] It is a more complicated problem because there are 
many metastable states in these glasses and therefore the averaging should 
be done at the beginning of calculations. The scaling of the action y/N which 
we got for p = 2 model is probably specific for the spherical model because 
the barriers in spin glasses with exponential number of states are due to the 
nonlinearity of the dynamical equations which is absent in p = 2 spherical 
model. 



Appendix A 

In this Appendix we will find the trajectory connecting the unstable fixed 
point with the stable one. It is natural to invert time in Eqs.(^^-^) so that 
they will describe the usual downhill motion: 

^ED. + S', = 1, (60) 

{d + eo + ~X)So = 0, (61) 
dD^ = -2(A + e^)^^ + 2, (62) 

where tilde means invertion of time with respect to the instanton motion, 
for example So{t) = So{—t). We need to find the solution of these equatiosn 
corresponding to the downhill trajectory that begins from the unstable fixed 
point and ends at the stable one. Therefore the initial boundary condition 
is (t = — oo) 

D,i-oo) = -^T-, /i>l, (63) 
So = 0, (64) 
A(-oo) = -ei + (65) 

A(-oo) = A„, (66) 
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and the final one {t = oo) is 

D^(oo) = /i>l, (67) 

A(oo) = -eo, (68) 

So ^ 0. (69) 

The solution of the Eg. ([6^) satisfying to the boundary condition (|63D is 

D,{t)=2 f dt'e-2/''[^(*")+^-]'^*" (70) 



Using Eqs.(|6T],|2D one can write Eq. (|60D in the form 

1 



X + eo = -]^^Y.(e,-e,)D, + l, (71) 



which will be more convenient for us. For simplisity let us take eo = further 
in this Appendix. Substitution of Eq.([70|) into Eq.(^) gives 



m = ^^Y.f dt'e-'I^'^'^'''^+^-^''''~X{t'). (72) 

A* ,, J —oo 

Introducing the function 

Fit) = r(t)A(t), (73) 
where T(t) is defined by (up to the multiplication by a constant) 

r(f) ' 
one can write Eq.(^) as a linear integral equation on F{t) 

m = ^f_Jt'F{t')Y.e-''^''-'\ (75) 

which can be easily solved giving 

F{t) = A e^^"*, (76) 
where A is an arbitrary constant. Now using Eq. (|73|) one can write 

Mt-t') _ 2 /; Xit")dt" /yyN 

"A(t') ' ^^^^ 
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then taking a logarithm and differentiating with respect to t we get a differ- 
ential equation on A 

dixit) = 2X{t)[K-X{t)], (78) 
which can be solved giving 

X{t)=XJ[2\Xu\{t-to)], (79) 

where 

/W = (80) 

and to is an arbitrary time which reffects the translational invariance in time. 
In case eo 7^ one can easily generahze Eg . (|79|) to 

X{t) + eo = (A, + eo)/[2 |A, + eo| {t - to)]. (81) 

Knowing X{t) one can find 

^mW = f[2\Xu + eo\{t-to)] 

Am + 

+-f[2\Xu + eo\ito-t)]. (82) 



Appendix B 

The main problem in calculation of the action is to find 



An = -Tr In 
^ 2 



-2 

-d + X + e, 



d + X + e, 



(83) 



Note that taking the variational derivative of (|83|) with respect to A(t) and 
0(t) we get respectively G^it^t) = 1/2 + G^(t) and \D^{t). The idea of our 
method of calculation of (|83D is to find a functional which gives the same 
functions {G^ + \ and |-D/^) when one takes the variations with respect to A 
and 0. Up to boundary terms this functional should be equal to the action, 
and these boundary terms can be found from the requirement that the action 
should be zero for any downhill trajectory. 

Now let us find the functional mentioned above: Eqs.( ^^ - |35| ) have the 
following invariant 

D^,b, - (1 + G,)G^ = c, (84) 



16 



where c is an arbitrary constant. But initially Gn = Du = 0, therefore c = 0. 



The condition (p4\ } can be satisfied automatically by introducing the new 
variables 

1 



D^ = ri^rif,, G^=r]^%- 1/2, D,, = %% 
The new variables rj^^T)^ satisfy the following equations 

dVi^ = (A + t^)fi^ + <l)Vf^~ TT^- 



(85) 

(86) 
(87) 



These equations can be obtained by taking the variations of the functional 



(88) 



with respect to 17 and 77. Note that the variational derivatives of (|83|) and 
with respect to A, are the same if we take at the saddle point with 
respect to 17,77, i.e. Eqs. ( |8^j87| ) should be satisfied. Therefore the action 
can be written as 

t=tf 



A, = T^ + T (D^{t), D^{t), G^{t), A(t), 0(t) 



t=ti 



(89) 



where T is an unknown function. The initial and final times ti and tf cor- 
respond to the fixed points of Eqs. (29 -35), therefore the abnormal functions 
Dfj,, G^, should be zero at these points and we can simplify 



t=tf 



t=ti 



(90) 



Using the saddle point equations 
the total action A getting 



|35|) and Eqs. (|86|j87D one can simplify 



A/N=- [dt(<P+-y^-—yd\nD.] 

+ {D,{t),X{t) 



t=tf 
t=ti 



(91) 



But this action should be zero for any downhill trajectory, therefore the third 

A/iV=^/rft(0+-^=^l. (92) 



and forth terms in (91) should cancel each other, and we finally get 

1 
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